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Executive Summary 



Policymakers have long been concerned about the disparities in college attendance between 
more and less advantaged groups of students. Data from the 1990s indicate that students from 
high-income families were more than twice as likely to attend a four-year college or university as 
students from low-income families, and this difference is not surprising given disparities in 
college preparation between high- and low-income high school students. While the vast majority 
of high-income high school graduates are qualified to attend a four-year college — based on 
grades and test scores — only half of low-income students have adequate qualifications (Lutz and 
Carroll, 1998). 

Upward Bound is one of the largest and longest running federal programs designed to help 
economically disadvantaged students prepare for, enter and succeed in college. Upward Bound 
is “designed to generate skills and motivation necessary for success in education beyond high 
school among young people from low-income backgrounds and inadequate secondary school 
preparation” (Public Law 90-222, Dec. 23, 1967). About 52,000 students now participate in 727 
regular Upward Bound projects around the country. At least two-thirds of each project’s 
participants must be both low-income and potential first-generation college students. Students 
typically enter the regular Upward Bound program while in ninth or tenth grade. Although 
students may participate in Upward Bound through the summer following twelfth grade (for 
three to four years total), participants typically remain in Upward Bound for about 21 months. 
Projects provide students with a variety of services, including instruction, tutoring and 
counseling. In addition to regularly scheduled meetings throughout the school year, projects also 
offer an intensive instructional program that meets daily for about six weeks during the summer. 
The vast majority of projects are hosted by four-year colleges. 

Since December 1991, Mathematica Policy Research, Inc., (MPR) has been conducting the 
national evaluation of Upward Bound for the U.S. Department of Education (ED). The 
evaluation has focused on program implementation issues and the effects of the program on 
student outcomes. The “impact study” is designed to measure the impacts or effects of regular 
Upward Bound on student outcomes, and it is based on a longitudinal evaluation in which 
eligible applicants from a nationally representative sample of projects were randomly assigned to 
Upward Bound or to a control group. Results from the implementation study were presented in 
Moore (1997a) and effects of Upward Bound on high school outcomes were presented in Myers 
and Schinn (1999). The results summarized here are based on the national evaluation’s third 
follow-up data collection, which was completed in 2000. Because the entire sample of students 
was beyond high school age by that time, the report includes updated findings on the effects of 
Upward Bound on high school outcomes. In addition, based on data covering the first few years 
after sample members left high school, the report addresses the following research questions: 



• What effect does Upward Bound have on students’ postsecondary experiences? 

• Who benefits most from Upward Bound? 

• What is the association between staying in Upward Bound and student outcomes? 
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Because few other programs provide the same intensive experience as regular Upward 
Bound, the opportunity to participate in regular Upward Bound is an opportunity for students to 
get additional help in preparing for college. However, because more intensive programs are 
costlier than less intensive ones, regular Upward Bound is considerably more expensive than 
most other precollege programs. The evaluation was designed to test whether students in regular 
Upward Bound experienced better postsecondary outcomes than if they had participated in other 
available, but typically less intensive, precollege programs. 



Methods and Data 

Methods 

The first two research questions were addressed by comparing the treatment group to the 
control group. Because eligible students were randomly assigned to these two groups, and 
because only treatment students were offered the opportunity to participate in Upward Bound, 
the differences between the two groups reveal the value-added of regular Upward Bound above 
and beyond the other programs and services that are available. Upward Bound operates in a 
service-rich environment, and students who are eligible for Upward Bound may participate in 
several precollege programs. Therefore, it is not surprising that many of the students assigned to 
both the treatment and control groups participate in precollege services other than regular 
Upward Bound. In fact, it is critical to the scientific validity of the study that students in the 
treatment and control groups have the same opportunities to pursue other services as the typical 
eligible applicant to regular Upward Bound. This report compares how eligible applicants fare 
when they are offered an opportunity to participate in the program to how they would fare 
without that opportunity. 

The third research question cannot be addressed using random assignment. To assess the 
effect of staying in the program for longer periods, the national evaluation used statistical 
methods that attempted to approximate the rigor of random assignment and, in doing so, allowed 
us to examine the association between length of participation and student outcomes. Students 
who stayed in the program for shorter periods of time were statistically matched with similar 
students who remained in the program for longer periods. Similarly, students who did not 
complete Upward Bound (did not stay until the spring of their senior year of high school) were 
matched with similar students who completed the program. Because the matching procedure 
may not have adjusted for all relevant differences between students who participated for different 
lengths of time, the results must be interpreted with greater caution than used when assessing 
results based on random assignment. 

Data Sources 

Several data sources have informed this report. A nationally representative sample of 67 
Upward Bound projects hosted by two- and four-year colleges was selected for the evaluation. 
In 1993, a survey of these projects was conducted. From 1992 to 1994, a baseline survey was 
conducted to obtain infonnation on students that applied to these projects. During the same 
period, eligible applicants in each project were randomly assigned to either a treatment group or 
a control group. About 1,500 students were assigned to the treatment group, and about 1,300 
were assigned to the control group. In 1994-1995, 1996-1997 and 1998-2000, follow-up surveys 
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were conducted. The response rates for these surveys were 97 percent, 86 percent and 81 
percent, respectively. High school and postsecondary transcripts were also collected. Finally, 
Upward Bound project staff reported on the participation of students in the program. 

When information was most recently collected on Upward Bound, the majority of students 
in the study had been out of high school for about two years. Because few students had an 
opportunity to complete college by that time, this report focuses on how Upward Bound affects 
preparation for college, college enrollment, the highest level of postsecondary education attended 
and initial progress in college. 1 Subsequent reports will examine college completion. 



Overview of Major Findings 

Findings in this report suggest that for the average student, Upward Bound (1) increased the 
number of high school math credits earned by participants, (2) did not affect other measures of 
high school academic preparation, (3) may have increased enrollment at four-year institutions 
and (4) did not affect enrollment at postsecondary institutions more generally when all types of 
postsecondary institutions are considered. Perhaps the most notable effect of Upward Bound 
was to increase the likelihood of attending four-year colleges and universities relative to other 
postsecondary institutions for students with lower educational expectations. 2 Finally, Upward 
Bound would have had larger effects if students remained in the program for longer periods of 
time. Below, we describe the findings in greater detail. 

Effects on Postsecondary Outcomes 

• Upward Bound had no effect on overall enrollment or total credits earned at 
postsecondary institutions, but it may have increased enrollment in four-year 
postsecondary institutions. Almost three-fourths of students in both the treatment 
group and the control group attended postsecondary institutions, broadly defined to 
include four-year institutions, two-year institutions, vocational schools and other 
postsecondary institutions. While the program may have increased the percent of 
students attending four-year colleges by about 6 percentage points, the evidence is not 
conclusive (see Chapter III). 



1 In this report, the highest level of postsecondary education is defined based on the types of postsecondary 
institutions that students attended. Students who had attended a four-year college or university were classified as 
having enrolled in a four-year institution. Students who had not attended a four-year college or university but had 
attended a two-year college were classified as having enrolled in a two-year institution. Students who had not 
attended either a four-year college or university or a two-year college but had attended a vocational school after high 
school were classified as having enrolled in a vocational postsecondary institution. 

2 Lower educational expectations were defined as expecting to complete less than a bachelor’s degree and 
higher expectations included completing a bachelor’s degree or higher. About 20 percent of the eligible program 
applicants had lower expectations. 
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• Upward Bound had a large effecs on enrollment at four-year colleges for students 
who had lower educational expectations. For students who had lower educational 
expectations when they applied to the program. Upward Bound more than doubled 
the percent attending four-year colleges and universities from 18 percent to 38 
percent (see Figure 1). For students with higher educational expectations. Upward 
Bound had no effect on enrollment at four-year colleges. 

• Upward Bound had a large effect on credits earned at four-year colleges by 
students who had lower educational expectations. Upward Bound more than 
doubled the number of credits that students with lower educational expectations 
earned in four-year colleges from 1 1 credits to 22 credits. However, Upward Bound 
had no effect on credits earned at four-year colleges by those with higher 
expectations. 

• Staying in Upward Bound for longer periods is associated with better student 
outcomes. Our findings suggest that Upward Bound participants would reap larger 
benefits from additional participation. Among students who applied for Upward 
Bound in ninth or tenth grade and left the program before the end of twelfth grade, 
program completion may increase the rate at which they attend postsecondary 
institutions by as many as 17 percentage points. For each of the same students, 
program completion may result in 16 additional postsecondary credits. Furthermore, 
for students who participated for two years or less, each additional year of Upward 
Bound may increase the rate at which participants attended postsecondary institutions 
by about 9 percentage points. Most of the increase in postsecondary attendance and 
credits earned is attributable to higher enrollment rates in four-year colleges and 
universities. However, these findings are based on nonexperimental methods and are 
therefore less reliable than other findings reported in this summary (see Chapter IV 
for more details). 



Effects on High School Outcomes 

• Upward Bound had limited or no effects on total high school credits or grades. 
Upward Bound had no effect on total credits and a small effect on credits earned in 
high school math. The program increased the number of math credits earned by 0.2 
credits; that is, about one in five students completed an additional high school math 
course because of their exposure to Upward Bound. Upward Bound had no effect on 
credits earned in science, English, social studies or foreign language courses. Also, 
the program had no effect on honors and Advanced Placement credits, grades earned 
in high school or high school graduation. 

• Upward Bound increased high school credits earned by students with lower 
educational expectations. For students with lower educational expectations, Upward 
Bound increased the number of credits earned in the five core academic subjects 
together by 2.0 credits, and it increased credits earned in two of those subjects 
individually — math and foreign languages — by 0.5 credits and 0.3 credits, 
respectively. Upward Bound also increased the number of credits earned in honors 
and Advanced Placement courses for students with lower expectations. 
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Figure 1 

Impact of Upward Bound on Postsecondary Enrollment, 
by Level of Educational Expectations 
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■ Four-year E3 Two-year □ Other 

Upward Bound had a significantly larger effect on the likelihood of attending a four-year postsecondary 
institution for students who did not expect to complete a bachelor's degree when they entered Upward 
Bound than for students who expected to complete a bachelor's degree at that time. 

Source: pst-hiexp.log and pst-loexp.log 
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I. Introduction 



A. Context and Purpose of Upward Bound 

Enrolling in college and completing a degree are important milestones for many young 
adults. Besides potential long-tenn benefits from college attendance and completion, such as 
increased wages, there are potential societal benefits that include reducing the burden on social 
service agencies and the criminal justice system, increasing local, state and federal tax revenues 
and, as some suggest, producing a more educated society that is better able to participate in a 
democratic fonn of government (see, for example, Decker et al. 1997; Oakes et al. 2000). 

Although completion of a college education is important from both the perspective of the 
individual and society, many potential college students lack the skills or the resources needed to 
enter college or complete a college degree. Those who face some of the greatest barriers to 
pursuing a postsecondary education often include young adults from low-income families and 
families where neither parent has acquired a bachelor’s degree; often, these same students are 
students of color (U.S. Department of Education 2001). Related to the low postsecondary 
enrollment rates for these students is the well-documented relationship between family 
socioeconomic status, race, ethnicity and high school academic preparation (see, for example, 
Coleman et al. 1966; Jencks et al. 1972; Mosteller and Moynihan 1972; Congressional Budget 
Office 1987; Jacobson et al. 2001). Although progress has been made to close the gap in 
achievement test scores between disadvantaged and more-advantaged students, large differences 
remain. For example, on achievement tests as reported by the National Assessment of 
Educational Progress, about 84 percent of African American students had scores that were lower 
than the typical white youth (Jencks and Phillips 1998). Furthermore, data from the National 
Education Longitudinal Study (1988-94) suggest that only half of low-income high school 
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